Evaluation of Radiology Teachers' Performance and Identification of the "Best Teachers" in a Residency Program: Mixed Methodology and Pilot Study of the MEDUC-RX32 Questionnaire.

RATIONALE AND OBJECTIVES: Radiology teachers are well trained in their specialty; however, when working in academic institutions, faculty development and promotion through the education pathway tends to be based on their teaching knowledge and skills. The aim of this study is to assess psychometric properties of the Medicina Universidad Católica-Radiology 32 items (MEDUC-RX32), an instrument designed to evaluate the performance of postgraduate radiology teachers and to identify the best teachers. MATERIALS AND METHODS: Mixed methodology was used, including qualitative and quantitative phases. The psychometric properties of the MEDUC-RX32 survey were performed by factor analysis (validity), Cronbach alpha coefficient, and G coefficient (reliability). The residents assessed their teachers and simultaneously voted for the "best teacher," which was used as a gold standard for the receiver operating characteristic curves construction comparing their votes with the global score. RESULTS: A total of 28 residents answered 164 surveys. The global score was 6.23 ± 0.8 (scale from 1 to 7). The factor analysis showed six domains of the resident's perception: (1) tutorial teaching, feedback, and independent learning; (2) communication and teamwork; (3) learning objectives; (4) respectful behavior; (5) radiological report; and (6) teaching and care support. The tutor's strengths were related with respectful behavior and teamwork. The instrument is highly reliable with a Cronbach alpha of 0.937 and a G coefficient of 0.831 (with a minimum of 8 residents). The MEDUC-RX32 instrument has a sensitivity of 91.7% and specificity of 83.3% to identify tutors as best teachers with at least one vote with an area under the receiver operating characteristic curve of 0.931 with a cutoff of 5.94. CONCLUSIONS: The MEDC-RX32 instrument is a multidimensional, valid, and highly reliable method to evaluate radiology teachers, identifying teachers with excellence in tutorial teaching in a postgraduate radiology program.

Identificación de las necesidades de capacitación docente de los jefes de programa de especialización médica / Identifying the main training needs of postgraduate medical program managers

Training of postgraduate medical specialty program managers (PMSPM) is essential for the proper development of their programs. Aim: To identify the main training needs of PMSPM at a medical school. Material and Methods: A mixed-methodology approach was implemented including focus group/interviews and the administration of the Program Managers Training Needs Assessment Questionnaire (PROMANAQ) developed by an expert panel with 59 items (with two sections: relevance/performance-self-perception). Higher priority was assigned to items with high relevance and low performance. Results: Forty five PMSPM completed the PROMANAQ (81.8% response rate). Both sections of PROMANAQ were highly reliable (Cronbach alpha of 0.95/0.97 for relevance/performance-self-perception, respectively). The items with higher priority value were evaluation of clinical educators, evaluation of teaching programs and accreditation of programs. Ten PMSPM were included in the focus group (18.2% of the universe). The findings of the qualitative component were concordant with the areas explored in the questionnaire. Conclusions: The PROMANAQ is valid and reliable to identify the training needs of PMSPM. The views of PMSPM must be taken into account for faculty development planning.

[Identifying the main training needs of postgraduate medical program managers]. / Identificación de las necesidades de capacitación docente de los jefes de programa de especialización médica.

BACKGROUND: Training of postgraduate medical specialty program managers (PMSPM) is essential for the proper development of their programs. AIM: To identify the main training needs of PMSPM at a medical school. MATERIAL AND METHODS: A mixed-methodology approach was implemented including focus group/interviews and the administration of the Program Managers Training Needs Assessment Questionnaire (PROMANAQ) developed by an expert panel with 59 items (with two sections: relevance/performance-self-perception). Higher priority was assigned to items with high relevance and low performance. RESULTS: Forty five PMSPM completed the PROMANAQ (81.8% response rate). Both sections of PROMANAQ were highly reliable (Cronbach alpha of 0.95/0.97 for relevance/performance-self-perception, respectively). The items with higher priority value were evaluation of clinical educators, evaluation of teaching programs and accreditation of programs. Ten PMSPM were included in the focus group (18.2% of the universe). The findings of the qualitative component were concordant with the areas explored in the questionnaire. CONCLUSIONS: The PROMANAQ is valid and reliable to identify the training needs of PMSPM. The views of PMSPM must be taken into account for faculty development planning.